Skip to content

PostGIS rework #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
nanth-uw wants to merge 15 commits into from
Closed

PostGIS rework #13

nanth-uw wants to merge 15 commits into from

Conversation

@nanth-uw
Copy link
Contributor

@nanth-uw nanth-uw commented Dec 17, 2025 •
edited
Loading

This rework utilizes the postgis tiger geocoder extension built in
functions to load the data.

There is also the issue of the database user (which I removed and is currently
the default postgres instead of the previous clad_svc user).

  • Remove these old folders
  • Remove repo files
  • Python-based alpine ruby image. No R required
  • Add csv thing
  • Add build dependencies and delete repo build dir
  • Add data folder ignores, but retain top level data folder
  • Also copy flag_flag to auto-start
  • Enable trivy scan
  • Use linux platform in run
  • Remove old scripts, move to scripts folder for ad-hoc usage
  • Move python code in scripts folder, extract sql queries into files
  • Add automated data download using postgis tiger functions

@nanth-uw nanth-uw mentioned this pull request Dec 17, 2025
Closed
@nanth-uw
Copy link
Contributor Author

nanth-uw commented Dec 17, 2025

For more information, these postgis tiger sql scripts come from here: https://postgis.net/docs/manual-3.6/en/Extras.html#Tiger_Geocoder

@nanth-uw
Copy link
Contributor Author

nanth-uw commented Dec 17, 2025

I'm pretty sure (but could be wrong) this simply need the user permissions fixed? And then the PG_USER in the python script adjusted.

@nanth-uw nanth-uw marked this pull request as ready for review December 19, 2025 17:45
@nanth-uw
Copy link
Contributor Author

nanth-uw commented Dec 19, 2025

This should now be ready for review and merging into main

@reukiodo
Copy link
Member

reukiodo commented Feb 13, 2026

I was able to manually merge the improved parts of this into the main branch so the benefits carry across:
using postgis:18-3.6-alpine
using the internal loader_generate_nation_script() and loader_generate_script() scripts to load data
simplifying the load to a single script
switching to 2024 data
including the territories

@reukiodo reukiodo closed this Feb 13, 2026
@reukiodo reukiodo deleted the postgis-rework branch February 13, 2026 05:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@nanth-uw @reukiodo